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AMENDMENTS TO THE SPECIFICATION 
The following paragraph is being added beginning on page 6, 
after line 21: 

Fig. 2 is a flowchart of a text generation method in 
accordance with the present invention. 

The paragraph beginning on page 6, line 22, is being amended 
as follows : 

Fig-: — 2- Fig. 3 is a subgraph illustrating a dependency 
structure analyzed by a text generation unit. 

The paragraph beginning on page 6, line 24, is being amended 
as follows: 

Fig. — 3- Fig. 4 is a dependency tree generated by the text 
generation unit . 

The paragraph beginning on page 1, line 1, is being amended 
as follows: 

Fig. — 4- Fig. 5 is a dependency tree in another sample 
sentence . 

The paragraph beginning on page 7, line 2, is being amended 
as follows: 

Fig. — & Fig. 6 illustrates an example of calculation of a 
probability that an order of word dependency is appropriate. 
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The following paragraph is being added beginning on page 7, 
after line 3 : 

Fig. 7 is a flowchart of a word insertion process in 
accordance with the present invention. 

The paragraph beginning on page 1 , line 24, is being amended 
as follows: 

If the keyword input unit (10) inputs three keywords (2) of 
"kanojo", "kouen", and "itta", the text and phrase searching and 
extracting unit (11) searches and extracts a text or a phrase, 
each containing at least one of the keywords captured from the 
database (13) . 

The paragraph beginning on page 8, line 7, is being amended 
as follows: 

This process will be discussed in more detail. In z'espons e 
to the keyword input by the keyword input unit — (10) , — the text and 
phras e — s e arching — and — e xtracting — unit — Hb^r) — extracts — a — sentenc e 

having — n — keywords — from — the — database — (13) . ft — ts — perfectly 

acceptable — if — oifte — keyword — ts — contained — in — bhe — sentence . The 

e xtract e d s e ntenc e is then s e nt to th e text g e neration unit — (12) . 
Fig. 2 illustrates a flowchart of a text generation method. The 
keyword input unit (10) performs a keyword capturing process (2 0) 
for capturing into the text generation apparatus (1) a keyword 
that is input by any input means such as an unshown keyboard, an 
unshown touch panel input device, or an input device of another 
computer connected to a network. 
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The following paragraphs are being added beginning on page 
8, after line 13 : 

The text and phrase searching and extracting unit (11) 
searches the database (13) for a sentence containing n keywords 
(21) in response to a keyword (2) captured by the keyword input 
unit (10). and extracts a found sentence (22). Searching 
technigues for searching the database (13) for a sentence 
matching a keyword are known as a character string extraction 
method, and a technigue permitting high-speed extraction is 
preferably used. 

A vast amount of sentences is available in the internet, and 
these contents can be used as the database (13) . Searching for 
contents may be limited to particular sites. For example, when a 
text relating to current events is generated, the use of sites of 
newspaper publishers may contribute to the generation of a 
precise text . 

It is sufficient if one keyword is contained at any rate. 
The extracted sentence is sent to the text generation unit (12), 
If no sentence is found in the text and phrase searching process 
(21) , the text generation apparatus (1) requests a user to add 
another keyword (23) , and an additional keyword is input using 
the keyword input unit (10) . 

The paragraph beginning on page 8, line 14, is being amended 
as follows: 

The text generation unit (12) includes the parser (12a) , the 
constructor (12b) , and the evaluator (12c) . The parser (12a) 
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performs a morphologically analyz e s — and parses analysis process 
(24) and a parsing process (25) on the extracted sentence. 

The paragraph beginning on page 8, line 18, is being amended 
as follows: 

Available as a morphological analyzing method (24) is a 
method of analyzing a morpheme based on an ME model, as disclosed 
in Japanese Patent Application No. 2001-139563 applied by the 
applicant of this application. 

The paragraph beginning on page 10, line 7, is being amended 
as follows: 

A parsing method (25) using — an ME — modei — may be — used as — a 
parsing — m e thod of the parser (12a) may also include a parsing 
technicpae based on an ME model . Any other parsing method may be 
used. The following method is used in one embodiment. The text 
generation unit (12) may references the database (13) , and learns 
a plurality of texts contained the database (13) in the ME model. 

The paragraph beginning on page 12, line 24, is being 
amended as follows: 

Subgraphs are searched (21) and extracted (22) from the 
database (13) according to the above keywords (2) and are 
analyzed . The subgraphs having high frequencies of occurrence 
are ones illustrated as a and b in Fig. 3a. 

Fig. 3a shows a sentence having a dependency structure of 
^^<noun> wa <noun> e <verb>^^ . Fig. 3b shows a sentence having a 
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dependency structure of "<noun> no <noun> e <verb>'^ ■ These 
sentences have respective keywords. 

Figs . 2« — and — 2b — illustrate — the — subgraphs — having — high 

frequenci e s of occurr e nce. Referring to Fig. 2a 3a, the keyword 
(kanojo wa) is a node (parent node 1) (20) (30) , and "<noun>+e" 
is a node (parent node 2) (21) (31) , and "<verb>." is a node 
(child node) (22) (32) , and a dependency relation — (23) structure 
(33) results. 

The paragraph beginning on page 13, line 11, is being 
amended as follows: 

It is assumed that n input keywords are in a dependency 
relation, and a dependency structure tree containing the n input 
keywords is generated (26) . To generate the tree, the subgraphs 
are combined. 

The paragraph beginning on page 13, line 15, is being 
amended as follows: 

For example, the three keywords are input, and it is assumed 
that the three keywords are in a dependency relation, and the 
subgraphs are combined (in this case, aligned) . Trees shown in 
Figs. 3a and 3b 4a and 4b thus result. 

The paragraph beginning on page 13, line 19, is being 
amended as follows: 

The above -referenced parsing method J^dependency modelj^ is 

again used to select which of the two generated trees (Figs. Sa 
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ttnd — 3b Figs. 4a and 4b ) as appropriate in an ordering process 
(26a) . 

The paragraph beginning on page 13, line 22, is being 
amended as follows: 

For the ordering of the dependency tree (26a) , the ratio of 
agreement between a combination of subgraphs, the frequency of 
occurrence, and the dependency relation are taken into 
consideration. If n is three or more, an ambiguity is present in 
the dependency relation between the n words. To solve the 
ambiguity, a dependency model is used. A word having a larger 
probability determined from the dependency model is ordered with 
higher priority. 

The paragraph beginning on page 14, line 5, is being amended 
as follows: 

As a result, the probability of the tree of Fig. 3a is 
higher, and the tree of Fig. 3a is selected as the optimum 
dependency relation structure (27) . 

The paragraph beginning on page 14, line 9, is being amended 
as follows: 

To contribute to the output of a more natural text in 
Japanese language, the most natural word order is preferably 
selected. In accordance with the present invention, the 
following re -arrangement of word order is possible. (Word order 
determination process (28) ) 
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The paragraph beginning on page 14, line 18, is being 
amended as follows : 

From the tree having the higher priority, a sentence is re- 
arranged in the natural word order and is output. Used to this 
end is a word order model based on the ME model that generates a 
natural order sentence from a dependency structure (28a) . The 
database (13) may be referenced to learn the word order model. 

The paragraph beginning on page 15, line 13, is being 
amended as follows: 

The embodiment of the present invention provides a technique 
to learn a relationship between elements in a sentence and the 
tendency of word order, namely, a regularity from a predetermined 
text . In the determination of word order (28) , this This 
technique learns the word order by referring to what element 
contributes to the determination of word order in what degree but 
also what combination of the elements results what tendency of 
the word order. This technique thus deductively learns a text. 
The degree of contribution of each element is efficiently learned 
using the ME model. The word order is learned by sampling two 
phrases at a time regardless of the number of modified phrases. 

The paragraph beginning on page 15, line 25, is being 
amended as follows: 

To generate a sentence, the learned model is used. With the 
phrases in dependency relation received, the order of the 
dependency phrases are determined. The decision of the word 
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order (28) is performed as below. 

The paragraph beginning on page 16, line 18, is being 
amended as follows: 

For example, an optimum word order is now determined in a 
sentence "kinou (yesterday) /tenisu wo (tennis) /Taro wa (personal 
name)/shita (played)." In the same way as already discussed, a 
dependency tree is produced. A structure tree having the highest 
probability is obtained as shown in Fig. — 4- Fig. 5 . 

The paragraph beginning on page 16, line 24, is being 
amended as follows: 

More specifically, words modifying verb "shita." (43) 
include three namely, "kinou" (40), "tenisu wo" (41), and "Taro 
wa" (42) . The order of the three words are determined (29) . 

The paragraph beginning on page 17, line 2, is being amended 
as follows: 

Fig. — 5 Fig. 6 illustrates a calculation example (50) of a 
probability that the order of the dependency phrases is 
appropriate . 

The paragraph beginning on page 17, line 9, is being amended 
as follows: 

For example, the probability of the word order of "kinou" 
and "Taro wa" in the chart is "p* (kinou, Taro wa)", and is 
assumed to be 0.6. Similarly, the word order of "kinou" and 
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"tenisu wo" is 0.8, and the word order of "Taro wa" and "tenisu 
wo" is 0.7, and the probability of the word order (51) at a first 

row in f4:g-: & Fig. 6 is determined by multiplying the 

probabilities, and is thus 0.336. 

The paragraph beginning on page 17, line 25, is being 
amended as follows: 

If a generalized node is contained in the word order model 
(28a) , the node is presented as is, and a location where a 
personal name, a geographic name, or a date is easy to place is 
known . 

The paragraph beginning on page 18, line 4, is being amended 
as follows: 

The dependency structure is received in the word order model 
(28a) in the above-referenced word order model. In accordance 
with the embodiment of the present invention, a word order model 
is used in a building process of the dependency structure. 

The paragraph beginning on page 18, line 18, is being 
amended as follows: 

The evaluator (12c) evaluates the text candidates (29) by 
putting together various information including the order of the 
input keywords, the frequency of occurrence of the extracted 
pattern, and a score calculated from the dependency model and the 
word order model. The evaluator (12c) may reference the database 
(13) . 
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The paragraph beginning on page 20, line 13, is being 
amended as follows: 

The present invention provides an insertion method that is 

performed when keywords are not sufficient. FiQ. 7 is a 

flowchart of an insertion process. 

The paragraph beginning on page 20, line 15, is being 
amended as follows: 

If n keywords are input (60) , inter-word space is filled 
using the ME model. Two keywords out of n keywords are extracted 
(61) and input to the model, and the insertion process is 
performed between the two keywords. 

The paragraph beginning on page 20, line 19, is being 
amended as follows: 

A determination is made of whether there is a word to be 
inserted between any two keywords (62) . If the number o f words 
to be inserted is one word, that word is inserted (65) . If there 
€tre is a plurality of words to be inserted between the two 
keywords (63) , the probability of occurrence of each of the words 
is determined (64) . An insertion operation is performed starting 
with a word having the highest probability (65) . This process is 
performed for each of any two words (66) . 

The paragraph beginning on page 21, line 1, is being amended 
as follows: 

The insertion operation is terminated when the probability 
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J of "no insertion" becomes highest between any two keywords (67) . 
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AMENDMENTS TO THE CLAIMS 

1. (Currently Amended) A text generation method for 
generating a text including a sentence, comprising: 

an input step for inputting at least a word as a keyword 
through input means , 

an extracting step for extracting, from a database, a text 
or a phrase related to the keyword through extracting means , and 

a text generation step for generating an optimum text based 
on the input keyword by combining the e xtract e d t e xt or phrase 
text or the phrase extracted by text generation means . 

2. (Currently Amended) A text generation method according 
to claim 1, furth e r comprising : wherein in an arrangement where 
the text is extracted in the extracting step, morphological 
analyzing and persing parser means morphologically analyzes and 
parses the extracted text in the text generation step, acquiring 
and acquires a dependency structure of the text, and generating 
wherein dependency structure generation means generates a 
dependency structure containing the keyword . 

3. (Currently Amended) A text generation method according 
to claim 2, further — comprising: wherein in the course of 
generating the dependency structure containing the keyword in the 
text generation step, d e termining the dependency structure 
generation means determines the probability of dependency of the 
entire text using a dependency model, and 

wherein generating the text generation means generates a 
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text having a maximum probability as an optimum text. 

4. (Currently Amended) A text generation method according 
to on e of claims 2 — and 3 claim 2 or 3 , further comprising : 
wherein in the middle of or after the generation of the 
dependency structure in the text generation step, g e nerating the 
text generation means generates an optimum text having a natural 
word order based on a word order model . 

5. (Currently Amended) A text generation method according 
to one of claims 1 through 4 claim 1 , further comprising: wherein 
in the text generation step, d e t e rmining by word inserting means 
determines, using a learning models whether there is a word to be 
inserted between any two keywords in all arrangements of the 
keywords, and p e rforming performs a word insertion process 
starting with a word having the highest probability in the 
learning model, wherein the word insertion means performs the 
word insertion process by including, as a keyword, a word to be 
inserted, or then removing the word as the keyword, and by 
repeating the cycle of word inclusion and removal until a 
probability that there is no word to be inserted between any 
keywords becomes the highest. 

6. (Currently Amended) A text generation method according 
to on e of claims 1 through 5 claim 1 , wherein in an arrangement 
where the database contains a text having a characteristic text 
pattern, the text generation strep means generates a text in 
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compliance with the characteristic text pattern. 

7. (Original) A text generation apparatus for generating a 
text of a sentence, comprising: 

input means for inputting at least one word as a keyword, 
extracting means for extracting, from a database containing 

a plurality of texts, a text or a phrase related to the keyword, 

and 

text generation means for generating an optimum text based 
on the input keyword by combining the extracted text or phrase. 

8 . (Original) A text generation apparatus according to 
claim 7, wherein in an arrangement where the text extracting 
means extracts the text, the text generation means comprises 
parser means for morphologically analyzing and parsing the 
extracted text, and acquiring a dependency structure of the text, 
and dependency structure generation means for generating a 
dependency structure containing the keyword. 

9. (Original) A text generation apparatus according to 
claim 8, wherein in the text generation means, the dependency 
structure generation means determines the probability of 
dependency of the entire text using a dependency model, and 

generates a text having a maximum probability as an optimum 

text . 
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10. (Currently Amended) A text generation method apparatus 
according to one of claims 0 and 9 claim 8 or 9 , wherein in the 
middle of or prior to the generation of the dependency structure, 
the text generation means generates an optimum text having a 
natural word order based on a word order model . 

11. (Currently Amended) A text generation apparatus 
according to one of claims 7 through 10 claim 7 , wherein the text 
generation means comprises word insertion means that determines, 
using a learning model, whether there is a word to be inserted 
between any two keywords in all arrangements of the keywords, and 
performs a word insertion process starting with a word having the 
highest probability in the learning model, wherein the word 
insertion means perforins the word insertion process by including, 
as a keyword, a word to be inserted, or then removing the word as 
the keyword, and by repeating the cycle of word inclusion and 
removal until a probability that there is no word to be inserted 
between any keywords becomes the highest. 

12. (Currently Amended) A text generation apparatus 
according to on e of claims 7 through 11 claim 7 , wherein in an 
arrangement where the database contains a text having a 
characteristic text pattern, the text generation means generates 
a text in compliance with the characteristic text pattern. 

13. (Original) A text generation apparatus according to 
claim 12, comprising pattern selecting means that contains one or 



16 



Docket No. 4035-0169PUS1 



a plurality of databases containing texts having a plurality of 
characteristic text patterns, and selects a desired text pattern 
from the plurality of text patterns. 
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REMARKS 



Claims 1-13 are pending in the present application. The 
specification and claims are being amended herein to place the 
application into a better form for examination. No new matter is 
being introduced by this amendment. 

Entry of the above amendments is earnestly solicited. An 
early and favorable first action on the merits is earnestly 
solicited. 

CONCLUSION 

If necessary, the Commissioner is hereby authorized in this, 
concurrent, and future replies, to charge payment or credit any 
overpayment to Deposit Account No. 02-2448 for any additional fees 
required under 37 C.F.R. §§ 1.16 or 1.17; particularly, extension 
of time fees. 



Respectfully submitted. 



BIRCH, STEWART, KOLASCH & BIRCH, LLP 
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